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(54) Graphical user interface for multimedia call set-up and call handling 

(57) A graphical user interlace, i.e., multimedia com- 
munications application program, for setting up and han- 
dling a multimedia call is disclosed that employs realistic 
metaphors of real life face-to-face meetings in setting up 
and handling a multimedia call to establish a virtual meet- 
ing which is automatically reconfigured in response to 
user action. This is realized by taking advantage of pro- 
spective virtual meeting participants' already existing 
knowledge of how real life face-to-face meetings oper- 
ate. To this end, the multimedia communications appli- 
cation program enables the virtual meeting participants 
through direct manipulation of the realistic graphical met- 
aphors to establish a realistic virtual meeting room which 
is displayed on the screen of their workstation monitor. 
The virtual meeting room includes a table and chairs 
arranged in a realistic manner in the virtual meeting 
room. The virtual meeting room and table are automati- 
cally configured in response to user action in such a man- 
ner as to minimize the screen area displaying the virtual 
meeting room and, thereby, maximizing the screen area 
available for multimedia collaboration by the meeting 
participants. An empty chair is displayed at the table 
which indicates that at least one more participant can be 
added to the virtual meeting. Once a predetermined 

t- maximum number of participants have been included in 

«^ the virtual meeting, the empty chair is no longer dis- 
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Description 
Technical Field 

This invention relates to telecommunications net- 
works and, more particularly, to multimedia communica- 
tions networks for providing flexible multimedia 
telephone service and the like including video, voice 
and/or data. 

Background Of the Invention 

The essential characteristics of face-to-face meet- 
ings can be simulated by multimedia telecommunica- 
tions conference systems. Such conference systems 
permit separated meeting participants to communicate 
with one another in multiple media such as video, voice 
and/or data from their own workplace without requiring 
that they convene in the same place. 

In prior known multimedia conference systems, it 
has been required that the individual meeting partici- 
pants had to be conversant with sophisticated video and 
data communications protocols, including, for example 
network address and transport protocols, in order to set- 
up and handle a multimedia call in order to establish and 
operate a virtual meeting. If a prospective participant 
was not familiar with the video and/or data protocols, it 
essentially precluded his or her participation in the full 
virtual meeting. Those prospective participants would be 
limited to only the audio portion of the virtual meeting. 
This of course is extremely undesirable. Therefore, a 
problem exists in providing an easy natural real life way 
for unsophisticated prospective meeting participants to 
set-up and handle multimedia telephone calls. 

Summary of the Invention 

The problems and limitations with prior multimedia 
telecommunications conference systems are overcome 
by utilizing a graphical user interface (multimedia com- 
munications application program) that employs realistic 
metaphors of real life face-to-face meetings in setting up 
and handling a multimedia call to establish a virtual meet- 
ing which is automatically reconfigured in response to 
user action. This is realized by taking advantage of pro- 
spective virtual meeting participants' already existing 
knowledge of how real life face-to-face meetings oper- 
ate. To this end, the multimedia communications appli- 
cation program enables the virtual meeting participants 
through direct manipulation of the realistic graphical met- 
aphors to establish a realistic virtual meeting room met- 
aphor which is displayed on the screen of their 
workstation monitor. The virtual meeting room includes 
a table and chairs arranged in a realistic manner in the 
meeting room. The virtual meeting room and table are 
automatically configured in response to user action in 
such a manner as to minimize the screen area displayed 
the virtual meeting room and, thereby, maximizing the 
screen area available for multimedia collaboration by the 



virtual meeting participants. In one embodiment an 
empty chair is displayed at the table which indicates that 
at least one more participant can be added to the virtual 
meeting. Once a predetermined maximum number of 
5 participants have been included in the virtual meeting, 
the empty chair is no longer displayed. In a specific 
example, the multimedia call is established by use of a 
realistic telephone icon that looks and operates like an 
ordinary real life telephone. 
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Brief Description of Drawing 

FIG. 1 is an example of a multimedia telecommuni- 
cations system in which the invention may be 

is employed; 

FIG. 2 shows, in simplified block diagram form, the 
relationships between the multimedia communica- 
tions application program (herein after multimedia 
application), middleware and the communications 

20 network; 

FIG. 3 shows, in simplified block diagram form, 
details of a workstation which may be employed in 
practicing the invention; 

FIG. 4 is a graphical screen representation of the 
25 realistic graphical meeting room metaphor; 

FIG. 5 is a graphical screen representation with the 
multimedia application minimized; 
FIG. 6 is a flow chart illustrating the steps a user per- 
forms in starting the multimedia application in the ini- 
30 tiation of a multimedia telephone call; 

FIG. 7 is a graphical screen representation which is 
displayed upon a user starting the multimedia appli- 
cation in the initiation of the multimedia telephone 
call; 

35 FIG. 8 is a flow chart illustrating the steps that the 
user would perform in selecting a telephone to initi- 
ate a multimedia call; 

FIG. 9 is a graphical screen representation of the 
call bar that appears when the telephone is selected 
40 to initiate the multimedia call ; 

FIG. 1 0 is a flow chart illustrating the steps in placing 
a multimedia call from the directory shewn in FIG. 
11; 

FIG. 1 1 is a graphical screen representation of a 
45 directory 

FIG. 12 is a graphical screen representation of a 
multimedia call initiated from an entry in the direc- 
tory; 

FIG. 13 is a flow chart illustrating the steps taken in 
so effecting a multimedia call directly from the call bar; 
FIG. 14 is a graphical screen representation illustrat- 
ing a phone number being entered directly from the 
keyboard of the user workstation; 
FIG. 15 is a graphical screen representation illustrat- 
55 ing ringing at a remote participant's phone number 
that is being displayed; 

FIG. 16 is a flow chart illustrating the steps taken in 
effecting a multimedia call from a dial pad; 
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FIG. 1 7 is a graphical screen representation illustrat- 
ing the appearance of the dial pad below the call bar; 
FIG. 1 8 is a graphical screen representation illustrat- 
ing a phone number entered on the dial pad; 
FIG. 1 9 is a graphical screen representation illustrat- s 
ing ringing at a remote participant's phone number 
that is being displayed; 

FIG. 20 is a flow chart illustrating the steps taken 
once the call is placed; 

FIG. 21 is a graphical screen representation illustrat- 10 
ing the meeting upon a remote participant answer- 
ing the call; 

FIG. 22 is a flow chart illustrating the steps which 
are taken upon receipt of an incoming call at a user 
workstation; 15 
FIG. 23 is a graphical screen representation illustrat- 
ing the name and phone number of the calling party; 
FIG. 24 is a graphical screen representation illustrat- 
ing the meeting room upon the called party answer- 
ing the incoming call; 20 
FIG. 25 is a flow chart illustrating the steps taken in 
adding a participant to an ongoing meeting. 
FIG. 26 is a graphical screen representation illustrat- 
ing an ongoing meeting with three participants; 
FIG. 27 is a graphical screen representation illustrat- 25 
ing an ongoing meeting with four participants; 
FIG. 28 is a graphical screen representation illustrat- 
ing the addition of a participant to the meeting shown 
on the screen of FIG. 26; 

FIG. 29 is a graphical screen representation illustrat- 30 
ing the addition of a participant to the meeting shown 
on the screen of FIG. 27; 

FIG. 30 is a graphical screen representation illustrat- 
ing the addition of an empty chair to the meeting 
shown in the screen of FIG. 28; 35 
FIG. 31 is a graphical screen representation illustrat- 
ing expansion of the meeting room for the meeting 
shown in the screen of FIG. 29; 
FIG. 32 is a graphical screen representation illustrat- 
ing the addition of an empty chair to the meeting 40 
shown in the screen of FIG. 31 ; 
FIG. 33 is a flow chart illustrating the steps taken 
when a meeting participant permanently leaves the 
meeting room; 

FIG. 34 is a graphical screen representation of an 45 
ongoing meeting including six participants; 
FIG. 35 is a graphical screen representation of the 
meeting shown in the screen of FIG. 34 upon a par- 
ticipant leaving that meeting; 
FIG. 36 is a graphical screen representation of the so 
meeting shown in the screen of FIG. 35 with the 
chairs rearranged; 

FIG. 37 is a graphical screen representation of the 
meeting with the participants rearranged around the 
table to fill in empty chairs; ss 
FIG. 38 is a graphical screen representation of the 
meeting shown in the screen of FIG. 37 with the extra 
empty chair being removed; 



FIG. 39 is a graphical screen representation of an 
ongoing meeting including five participants; 
FIG. 40 is a graphical screen representation of the 
meeting shown in the screen of FIG. 39 upon a par- 
ticipant leaving that meeting; 
FIG. 41 is a graphical screen representation of the 
meeting shown in the screen of FIG. 40 with the 
chairs rearranged; 

FIG. 42 is a graphical screen representation of the 
meeting with the participants rearranged around the 
table to fill in empty chairs; 
FIG. 43 is a graphical screen representation of the 
meeting shown in the screen of FIG. 42 with the extra 
empty chair being removed; 
FIG. 44 is a graphical screen representation illustrat- 
ing the shrinking of the size of the meeting room; 

Detailed Description 

FIG. 1 shows an example of multimedia telecommu- 
nications system 100 in which an embodiment of the 
invention may be readily employed. Individual users at 
different work locations can set-up a multimedia confer- 
ence call via a number of different desktop communica- 
tions devices. As shown, the desktop communications 
devices may include, but are not limited to, personal com- 
puter 101 with built in microphone for audio, workstation 
102 including an attached video camera 103 and ISDN 
telephone 104, workstation 105 with attached video 
camera 106, personal computer 107 with an integrated 
video camera 1 08, workstation 109 including video cam- 
era 1 1 0 and an analog telephone 111, ISDN telephone 
112, facsimile (FAX) machine 113 and, finally, analog tel- 
ephone 1 1 4. It should be noted that personal computer 
101 does not provide local user video to the meeting, 
FAX machine 113 only provides FAX service and ISDN 
telephone 1 12 and analog telephone 114 only provide 
audio access to the meeting. The personal computers 
and workstations may be any of those known in the art, 
for example, personal computers and/or workstations 
commercially available from AT&T Corp., Apple Compu- 
ter Inc., Sun Microsystems Inc. and others. 

The several different desktop communications 
devices are interconnected via communications network 
116. Note that workstations 101, 102, 107 and 109, and 
ISDN telephone 112, facsimile machine 113, and analog 
telephone 114 are directly connected to communications 
network 116, while workstation 105 is connected through 
multimedia server 1 15 to communications network 116. 
In this example, communications network 1 1 6 could be, 
for example, a long distance telecommunications net- 
work such as a long distance network provided by AT&T. 
It may be connected to a number of local telephone net- 
works provided by local exchange carriers or alternate 
access vendors to provide access to the different desk- 
top communications devices. Alternatively, communica- 
tions network 1 1 6 could be a wide band area network, a 
local area network or the like. Typically, communications 
network 116 may include the usual public switched long 
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distance network composed of a plurality of well known 
digital switching units and may contain one or more 
packet networks. Additionally, communications network 
116 may include known video conference bridge 
arrangements capable of conferencing video, audio 5 
and/or data bit streams among the different desktop 
communication devices. 

Communications network 116 may also include mul- 
timedia multipoint control units (MCUs) that provide mul- 
timedia call capability including video, audio and/or data 10 
bit streams. Such MCU units are known and are 
described in Bell Core Generic Requirements GR-1337- 
CORE, Issue 1 , September 1993 and entitled "Multipoint 
Multimedia Conferencing Control Unit". Furthermore, 
communications network 116 may include an asynchro- 15 
nous transport mode (ATM) network capable of trans- 
porting and switching multimedia calls including video, 
audio, and/or data bit streams. 

As indicated above, workstation 105 is connected 
via multimedia server 1 15 to communications network 20 
116. Multimedia server 115 provides for one or more 
video one or more audio and one or more data bit 
streams to be combined, while maintaining the integrity 
of those bit streams for transmission to communications 
network 1 1 6, for workstation 1 05 and the other desktop 25 
communications devices in a particular meeting includ- 
ing workstation 105. The functionality of multimedia 
server 115 can be provided for a particular workstation 
locally, as shown in relationship to workstation 105, and 
for the other desktop communications devices in a meet- 30 
ing including workstation 1 05. It is noted that for the other 
desktop communications devices in a meeting not 
including workstation 105 and multimedia server 115, 
communications network 116 must provide the multime- 
dia server functionality for them. 35 

Thus, communications network 116, which is not 
part of this invention, provides the functionality including 
the multimedia server functionality, when necessary, for 
interconnecting selected ones of the desktop communi- 
cations devices in particular virtual meetings, as desired. 40 

FIG. 2 illustrates in simplified block diagram form 
how multimedia application, i.e., the graphical user inter- 
face, 201 (201*) located on the user personal computer 
or workstation communicates via application program 
interfaces that connect to middleware 202 (202*). Note 45 
that the solid lines in FIG. 2 denote direct connectivity 
between elements 201 through 203 and 203' through 
201 ', and vice versa, while the dotted lines denote logical 
connectivity between, for example, elements 201 and 
201*, and 202 and 202'. Middleware 202 (202*) is soft- so 
ware that is located at the workstation and also distrib- 
uted among intelligent points in communications network 
116. Middleware 202 (202*) serves to isolate the multi- 
media application from platform differences (e.g., UNIX 
versus MS-DOS and the like) and communications net- ss 
work 1 16 details. Middleware 202 (202*) also serves as 
a link between the workstation application programs, for 
example, 201, and network transport 203 server func- 
tions, as well as, applications that include, but are not 



limited to, multimedia call connection setup, directory 
services of people and network resources, information 
services, messaging services, and the like. When a user 
places or receives a multimedia call from his or her work- 
station, the workstation automatically registers its capa- 
bilities with middleware 202 (202'). Middleware 202 
(202*) employs the registered capabilities to control call 
setup and transmission of video, audio and/or data. 
Since, all the capabilities (e.g., full-video, shared data, 
facsimile, audio and the like) from all of the meeting par- 
ticipants 1 workstations are registered with middleware 
202 (202*) , it is available to all of the meeting participants. 
When information is to be transmitted to participants in 
the multimedia meeting, middleware 202 (202*) deter- 
mines the proper display formats and transport proto- 
cols. Such middleware is known in the art, see for 
example, an article entitled "Middleware's Next Step: 
Enterprise-Wide Applications'*, Data Communications. 
Sept. 1992, pages 157-164 and an article entitled 
"Closeup Middleware: Networking's Silly Putty", Com- 
munications Week. June 20, 1994, pages 43-49. 

FIG. 3 shows, in simplified block diagram form 
details of a user's workstation. Specifically, shown is cen- 
tral processing unit (CPU) 301 which is interconnected 
via bus 302 to random access memory (RAM) 303, data 
memory 304, which may be a ROM, and input/output 
(I/O) unit 305. I/O 305 interfaces pointing device 306, 
video camera 307, if available, telephone 308, analog or 
ISDN if available, keyboard 309, and display device 310 
to bus 302 and to network interface 31 1 . Such worksta- 
tions units are known in the art and commercially avail- 
able, as indicated above, and provide shared data 
capabilities. Network interlace 31 1 comprises an appli- 
cation program interface that translates computer appli- 
cation requests into the appropriate transport format for 
transmission via communications network 1 16 and also 
takes requests from communications network 116 and 
translates them into a format appropriate for interacting 
with the workstation's applications program. Such 
arrangements are known in the art. It is further noted that 
transmission from a user workstation to communications 
network 1 1 6 may be via any of a number of transmission 
arrangements for example, digital data system (DDS), 
basic rate interface (BRI) ISDN, primary rate interface 
(PRI) ISDN, a modem, analog transmission, digital trans- 
mission, facsimile transmission, or the like. It is noted that 
a mouse, track ball touch screen, keyboard cursor con- 
trol keys or the like may be employed as a pointing 
device. 

FIG. 4 is a graphical screen representation of the 
real life meeting room metaphor illustrating the various 
components that could be included in a multimedia meet- 
ing. Shown in FIG. 4 is image icon 401, illustrating the 
image of the originator of the meeting, realistic telephone 
402 which is used to place and receive multimedia calls, 
image icon 403 of a participant in the meeting, empty 
chair 404 which is available for an additional participant 
to be included in the meeting, generic image icon 405 
which would be employed for a participant whose bit map 
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image is not available, table 406 on which objects can 
be placed to be shared among the meeting participants, 
projector 407 which is shown on table 406 and may be 
utilized to share images among the participants, and 
view graph folder 408 which contains images that can be 
placed on the projector 407. Also, shown in FIG. 4 is tool 
closet 409, which includes the multimedia tools that may 
be utilized during a multimedia meeting by the partici- 
pants. Shown in tool closet 409, in this example, are cop- 
ier 410 which may be utilized by the participants to send 
computer files from one participant to one or more of the 
other participants, application sharer (link) 41 1 which 
enables the participants to share a computer application 
program, screen snapshot camera 412 which is used to 
create a view graph by taking a snapshot of any portion 
of the monitor screen, call timer 413 which times the 
length of the multimedia call and can be used to set an 
alarm, slide projector 41 4 which is used to display a pres- 
entation of a sequence of one or more images to the 
meeting participants, and FAX machine 415 which is 
used to send facsimiles to meeting participants and oth- 
ers. The instrumentalities shown in tool closet 409 are 
by way of example and any other desired multimedia 
tools may also be included. It is noted that tool closet 409 
may be closed to save screen space on the user's work- 
station monitor screen. Note that the icons are of realistic 
real life objects that are or should be well known to the 
meeting participants. Since, all of the objects are well 
known as to their nature and use, the meeting partici- 
pants do not need to know any sophisticated protocols 
in order to use them. Indeed, the virtual meeting partic- 
ipants use the realistic icons in the same manner as they 
would their real life counterparts. Additionally, the image 
icons of the meeting participants are arranged around 
the table in similar fashion as the participants would be 
seated in a real life face-to-face meeting. This allows the 
participants to interact with each other and use the 
objects in the meeting room based on their already exist- 
ing knowledge. This, in turn, enhances the ease of use 
of the graphical user interface of this invention. 

FIG. 5 is a graphical screen representation with the 
multimedia application (MMECA) 501 minimized. Also 
shown are a number of other application programs which 
have been minimized. Note that the multimedia applica- 
tion of this invention can be implemented on top of a 
number of known personal computer systems. Exam- 
ples of such systems programs are the Vistium* personal 
video system commercially available from AT&T Corp. 
and the ProShare* personal conferencing system 200 
commercially available from Intel Corporation (* note that 
Vistium is a trademark of AT&T Corp. and that ProShare 
is a trademark of Intel Corporation). In this example, it is 
assumed that the personal video system is included as 
part of the user workstation and provides the network 
interface 311 (FIG. 3). 

FIG. 6 is a flow chart illustrating the steps in utilizing 
the multimedia application for initiating a multimedia tel- 
ephone call. In step 601, a user initiates a multimedia 
call. Then, in step 602, the user determines whether or 



not the multimedia application is running. If the test result 
in step 602 is YES, in step 603, the user determines 
whether the multimedia application is minimized. If the 
test result in step 603 is YES, the user selects the mini- 

5 mized multimedia application icon 501 , as shown in FIG. 
5. Thereafter, control is transferred to step 605 in which 
the meeting room window opens as shown in the screen 
of FIG. 7. Returning to step 603, if the test result is NO, 
the multimedia application is not minimized and the 

w meeting room window is already open, as shown in the 
screen of FIG. 7. Returning to step 602, if the test result 
is NO, in step 607, the user starts the multimedia appli- 
cation in a manner consistent with the operating system 
employed in the user workstation. Thereafter, control is 

is passed to step 605 where the meeting room window 
opens and is displayed; as shown in the screen of FIG. 7. 

FIG. 7, as indicated above, is a graphical screen rep- 
resentation displayed upon a user starting the multime- 
dia application upon initiating a multimedia call. In the 

20 example shown in FIG. 7, image icon 701 is of the mul- 
timedia call originator. Also shown is telephone 702 
which may be used to originate the multimedia call, 
empty chair 703 which is availabl e for an additional meet- 
ing participant to join the meeting in the multimedia call, 

25 table 704 which is used to share objects among the par- 
ticipants, projector 705 which is used to share images 
among the meeting participants, view graph folder 706 
which contains the images to be shared among the meet- 
ing participants, and tool closet 707 which is closed. 

30 Again, note that the icons are of realistic real life objects 
which are well known to the meeting participants. 

FIG. 8 is a flow chart illustrating the steps taken in 
the user selecting telephone 702 (FIG. 7) to initiate a mul- 
timedia call. Thus, in step 801 , the user selects the real- 

35 istic telephone icon 702. This causes a call bar to appear 
on the screen adjacent to telephone 702, as shown in 
the screen of FIG. 9. The call bar includes a field 901 for 
the user to enter a number to be called directly from the 
workstation keyboard, and a dial pad button 902, which 

40 when selected will display a dial pad for entering the 
number. Additionally, in this example, option buttons 903 
and 904 are provided to select either a local on-line tel- 
ephone directory or a corporate telephone directory 
located on the network. It should be noted that the direc- 

45 tories associated with option buttons 903 and 904 are 
just examples of such directories that can be utilized for 
selecting the number to be called. 

FIG. 10 is a flow chart illustrating the steps the user 
takes in placing a call from a multimedia directory. Thus, 

so the process is initiated via step 1001 from the screen 
shown in FIG. 9. Then, in step 1 002, the user selects the 
call initiation technique which, in this example, is the 
directory. This causes the directory application window 
to open via step 1003 and is shown in the screen of FIG. 

55 11. The directory, shown in the window of FIG. 1 1 , is just 
one example of numerous such directories that may be 
employed. Then, in step 1004, the user searches for the 
name of the desired prospective participant to be called 
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in the multimedia call. This is realized by the user brows- 
ing through the directory. 

Upon the user locating the name of the desired pro- 
spective meeting participant, he or she places the mul- 
timedia call via step 1005. The call placement may be 
effected by any desired method, one of which is to select 
call button 1101, as shown adjacent to the prospective 
participant's telephone number in FIG. 11. The place- 
ment of the call by the user in step 1005 causes the 
screen as shewn in FIG. 1 2 to be displayed via step 1 006. 
As shown in FIG. 12, the call bar adjacent to the tele- 
phone displays the name and telephone number of the 
prospective meeting participant that was dialed. 

FIG. 13 is a flow chart illustrating the steps the user 
takes in effecting a multimedia call directly from the call 
bar, shown in FIG. 9. This process is initiated in step 1 301 
from the screen shown in FIG. 9. Then, in step 1302, the 
user enters the desired participant's telephone number 
on the local workstation keyboard. This causes the tele- 
phone number being dialed to appear in the call bar, as 
shown in the screen of FIG. 14. Then, in step 1303, the 
user, in this example, presses enter on the keyboard to 
cause the displayed number to be dialed, which also 
causes the call bar to display that the number is being 
dialed, as shown in the screen of FIG. 15. 

FIG. 16 is a flow chart illustrating the steps a user 
would take in effecting a multimedia call from the dial 
pad. This process is initiated in step 1601 from the 
screen of FIG. 9. In this instance, the user selects the 
dial pad option 902 from the call bar via step 1 602, which 
causes the dial pad to appear on the screen, as shown 
in the screen of FIG. 17. Then, in step 1603, the user 
enters the desired participant's telephone number from 
the dial pad using a pointing device such as a mouse. 
This, in turn, causes the number entered to appear in the 
call bar, as shown in the screen of FIG. 18. Then, in step 
1604, the user selects the dial button from the dial pad, 
which causes the telephone number to be dialed. This, 
causes the call bar screen to display that the number is 
being dialed, as shewn in the screen of FIG. 19. 

FIG. 20 is a flow chart illustrating the steps which 
are taken once the multimedia call is placed, as dis- 
played in either of the screens in FIGS. 12, 15 or 19, as 
initiated via step 2001 . Then, as shown in either of FIGS. 
12, 15 or 19, and as indicated in step 2002, the call has 
been placed and the dialed number and the name of the 
called participant, if available, appear in the call bar, as 
well as, a hang up option. Then, step 2003 tests to deter- 
mine if the call has been answered. If the test result in 
step 2003 is NO, in step 2004, the user selects the hang 
up option from the call bar. Thereafter, the call bar is 
removed and the screen appears, as shown in FIG.7. 
Returning to step 2003, rf the test result is YES, step 
2006 causes the call to begin with audio only, causes the 
call bar to be removed from the screen, and causes an 
icon of the called participant to be placed in the meeting 
room on a chair, as shown in the screen of FIG. 21 . It is 
noted that if the participant's image bit map is not avail- 
able the generic image icon 405 will appear instead. 



FIG. 22 is a flow chart illustrating the steps which 
are effected upon receipt of an incoming multimedia call 
at a prospective meeting participant's workstation. The 
process is entered with the incoming call via step 2201 . 

s Thereafter, step 2202 tests to determine if the multime- 
dia application is running at the prospective participant's 
workstation. If the test result in step 2202 is NO, step 
2203 causes only the telephone to ring. Then, the only 
option available to the called participant is to participate 

10 in the audio portion of the meeting. Returning to step 
2202, if the test result is YES, step 2204 causes audible 
ringing to occur, the meeting room to appear on the par- 
ticipant's screen and the call bar to appear next to the 
telephone in a realistic meeting room metaphor, as 

75 shown in the screen of FIG. 23. Additionally, as shown 
in the screen of FIG. 23, the name and number of the 
calling party is displayed in the call bar. Then, in step 
2205, the participant selects a desired call bar option. 
Thereafter, step 2206 tests to determine which option 

20 has been selected by the participant, namely, ignore, 
answer or other. If the test result in step 2206 indicates 
that the ignore option is selected, step 2207 causes the 
telephone to stop ringing, the realistic meeting room met- 
aphor to be minimized and the call follows whatever call 

2s path has been setup by the network (for example, with a 
PBX the call could be sent to voice mail or to coverage) 
and the called participant's screen appears as shown in 
FIG. 5. Returning to step 2206, if the called participant 
selects other, step 2208 causes the called participants 

30 workstation to perform any system specific action that 
the participant desires, such as voice mail or the like. 
Again, returning to step 2206, if the called participant 
selects answer, step 2209 causes the called participant's 
workstation to register its capabilities with the communi- 

35 cations network middleware, the call bar on the called 
participant's screen is removed and the screen displays 
the real life meeting room with icons representing all the 
current meeting participants including the called partici- 
pant being placed around the table in a realistic manner 

40 as would occur in a real life face-to-face meeting, as 
shown in the screen of FIG. 24. 

FIG. 25 is a flow chart illustrating the steps that are 
taken in the automatic reconfiguration of the room and 
table when adding a participant to an ongoing virtual 

45 meeting. This process of adding a participant is initiated 
by step 2501 from either a meeting having an odd 
number of participants as shown in the screen of FIG. 
26 or a meeting having an even number of participants 
as shown in the screen of FIG. 27. Then, step 2502 

so causes the participant to be added to the empty chair in 
the meeting room, as shown in the screens of either FIG. 
28 or FIG. 29. Once the participant has been added, step 
2503 tests to determine if the number of participants has 
reached a predetermined maximum. If the test result in 

55 step 2503 is YES, the process is ended via step 2504, 
since no more participants can be added. Note that since 
the maximum number of participants has been reached, 
the room cannot be expanded nor can an empty chair be 
added for any additional participants, if the test result in 
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step 2503 is NO, step 2505 tests to determine if there is 
room to add an empty chair around the meeting table, 
i.e. whether there is an even number of participants, If 
the test result in step 2505 is NO, step 2506 causes the 
virtual meeting room and the table to expand by one par- 
ticipant space, as shown in the screen of FIG. 31 . There- 
after, control is passed to step 2507. If the test result in 
step 2505 is YES, control is passed directly to step 2507, 
which causes an empty chair to be added to the virtual 
meeting room. This is shown in the screen of FIG. 30 for 
a room which did not require expansion and in the screen 
of FIG. 32 for a room which has been expanded. There- 
after, step 2508 causes the automatically reconfigured 
meeting(s) to continue. 

FIG. 33 is a flow chart illustrating the steps taken in 
the automatic reconfiguration of the meeting room and 
table when a participant permanently leaves the virtual 
meeting room. This process is initiated in step 3301 from 
an ongoing meeting having either an even number of par- 
ticipants, as shown in the screen of FIG. 34, or an odd 
number of participants, as shown in the screen of FIG. 

39. Then, in step 3302, a test is made to determine 
whether a participant has permanently left the virtual 
meeting room, as shown in the screens of FIGs. 35 and 

40, for the meeting shown in the screens of FIGs. 34 and 
39, respectively. If a participant temporarily leaves the 
meeting (puts the call on hold) the room does not recon- 
figure and the particular participant's chair will remain 
empty until he or she returns. Step 3303 causes the 
meeting participants of the virtual meeting on the same 
side of the table below the empty chair of the participant 
who left to move up one chair, as illustrated in the 
screens of FIGs. 36 and 41 . Thereafter, step 3304 tests 
whether or not there are two empty chairs on the same 
side of the table, tf the test result in step 3304 is YES, 
step 3305 causes the person in the chair at the bottom 
of the table to move from the other side of the table to 
the top empty chair, as shown in the screens of FIGS. 37 
and 42. Thereafter, control is passed to step 3306 which 
tests to determine whether or not there are two empty 
chairs around the table. Returning to step 3304, if the 
test result is NO, control is directly passed to step 3306. 
If the test result in step 3306 is NO, there is only one 
empty chair and the process is ended via step 3307. If 
the test result in step 3306 is YES, step 3308 causes an 
empty chair at the lowest point of the table or on the left 
side of the table to be removed, as shown in the screens 
of FIGs. 38 and 43. Then, step 3309 tests whether or not 
there is excess space at the bottom of the table so that 
the room and table can be shrunk in size, i.e. whether or 
not there is an even number of participants in the virtual 
meeting room, as shown in the screen of FIG. 43. If the 
test result in step 3309 is NO, the process is ended via 
step 3307. If the test result in step 3309 is YES, the table 
and room are shrunk by one chair space, as shown in 
the screen of FIG. 44, and the meeting is continued 
including the automatically reconfigured room and table. 



Claims 

1. A method for use in a user workstation including a 
pointing device and a visual display unit to provide 

5 a graphical user interface for graphically depicting in 
a realistic manner setting up and/or handling of a 
multimedia call for a multimedia virtual meeting, 
comprising the steps of: 

Initiating a multimedia call from the user 
10 workstation to at least one prospective participant of 
the virtual meeting; 

displaying in an area on a screen of the visual 
display unit at the user's workstation a graphical rep- 
resentation of a realistic virtual meeting room mete- 
rs phor including realistic icons of at least a table, the 
user's image, at least one empty chair and a tele- 
phone, wherein the user's image icon and the at 
least one empty chair icon are positioned around the 
table icon in a realistic, real life manner and the real- 
20 istic telephone icon is for use in setting up a multi- 
media call to the at least one prospective virtual 
meeting participant; and 

causing the realistic icons to be arranged in 
the virtual meeting room metaphor being displayed 
25 so that the screen area displaying the virtual meet- 
ing room is minimized. 

2. The method as defined in claim 1 further including 
the steps of selecting the realistic telephone icon 

30 and displaying a call bar on the screen in predeter- 
mined spatial relationship to the virtual meeting 
room metaphor in response to the selection of the 
telephone icon, the call bar including at least one 
option to be used in placing the multimedia call. 

35 

3. The method as defined in claim 2 wherein the call 
bar includes at least a dial pad option which can be 
employed in placing the multimedia call and an area 
for displaying a telephone number and further 

40 including the steps of selecting the dial pad option 
to place the multimedia call, displaying on the screen 
a realistic dial pad icon, inputting the at least one 
prospective participant's telephone number via the 
dial pad, displaying the telephone number being 

45 inputted in the call bar and causing the displayed 
number to be dialed. 

4. The method as defined in claim 2 wherein the call 
bar includes at least a directory option which can be 

so employed in placing the multimedia call and an area 
for displaying a telephone number, the directory 
including at least names and telephone numbers of 
individuals and further including the steps of select- 
ing the directory option to place the multimedia call, 

55 displaying on the screen a realistic directory page 
icon, locating the name and telephone number in the 
directory of the at least one prospective participant, 
selecting the at least one prospective participant's 
telephone number from the directory, displaying the 
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selected telephone number in the dial bar and caus- 
ing the displayed number to be dialed. 

5. The method as defined in claim 2 wherein the user 
workstation includes a keyboard having number s 
keys and the call bar includes an area for displaying 

a telephone number and further including the steps 
of inputting the at least one prospective participant's 
telephone number via the keyboard number keys, 
displaying the telephone number being inputted in w 
the dial bar and causing the displayed number to be 
dialed. 

6. The method as defined in claim 1 further including 
the steps of selecting the realistic telephone icon is 
and displaying a call bar on the screen in predeter- 
mined spatial relationship to the virtual meeting 
room metaphor in response to the selection of the 
telephone icon, the call bar including at least an area 

to display a telephone number to be dialed, supply- 20 
ing a telephone number of the at least one prospec- 
tive participant to be dialed, displaying the supplied 
telephone number in the call bar area and causing 
the displayed number to be dialed, determining if the 
dialed number has been answered, if the dialed 25 
number is answered, removing the call bar from the 
display and displaying an image icon representative 
of the answering virtual meeting participant over the 
empty chair. 

30 

7. The method as defined in claim 6 further including 
the steps of determining if the number of participants 
in the virtual meeting is a maximum allowable 
number and if not, adding an empty chair at the table 
indicating that another prospective participant may 35 
be added to the virtual meeting. 

8. The method as defined in claim 7 further including 
the steps of determining if the virtual meeting room 
and table need to be expanded to accommodate the 40 
added empty chair and, if so, expanding the size of 
the virtual meeting room and table just enough to 
accommodate the added empty chair. 

9. The method as defined in claim 1 wherein the meet- 45 
ing room includes a tool closet including tools to be 
employed in the multimedia virtual meeting for col- 
laboration and/or communication among the virtual 
meeting participants, the tool closet being initially in 

a closed condition so that the screen area displaying so 
the virtual meeting room is minimized. 

10. The method as defined in claim 9 further including 
the steps of opening the tool closet and displaying 

on the screen realistic icons of the multimedia tools ss 
so that any one of the virtual meeting participants 
having a workstation including a pointing device and 
a visual display unit may select a tool from the 
opened tool closet to collaborate and/or communi- 



cate with one or more of the virtual meeting partici- 
pants. 

1 1 . The method as defined in claim 6 wherein a number 
of virtual meeting participants have been called and 
have been added to the virtual meeting with an 
image icon of each of the number of the added par- 
ticipants being placed over a respective chair around 
the table icon and further including the steps of 
determining if one or more of the virtual meeting par- 
ticipants have left the virtual meeting, if so, removing 
the image icons of the one or more participants that 
have left and displaying empty chairs around the 
table icon in place of the removed one or more image 
icons. 

12. The method as defined in claim 1 further including 
the steps of rearranging the image icons around the 
table icon of the remaining virtual meeting partici- 
pants to fill the one or more empty chairs if they are 
above the image icons of the remaining participants, 
rf there are more than one empty chairs, removing 
all but one of the empty chairs, determining if there 
is space to shrink the length of the displayed virtual 
meeting room and, if so, shrinking the length of the 
virtual meeting room and the table to a length long 
enough to accommodate the image icons of the 
remaining virtual meeting participants and the one 
empty chair. 

13. A method for use in a user workstation including a 
pointing device and a visual display unit and a tele- 
phone to provide a graphical user interface for 
graphically depicting in a realistic manner handling 
of a multimedia call for a user to join a multimedia 
virtual meeting, wherein the steps of: 

receiving an incoming multimedia call; 

determining if a multimedia application pro- 
gram is running on the user workstation, if not, ring- 
ing only the telephone, rf so, sounding an audible 
alert signal at the user workstation to inform the user 
of the incoming multimedia call; 

displaying in an area on a screen of the visual 
display unit at the user's workstation a graphical rep- 
resentation of a realistic virtual meeting room meta- 
phor including realistic icons of at least a table, the 
user's image, at least one empty chair and a tele- 
phone, wherein the user's image icon and the at 
least one empty chair icon are positioned around the 
table icon in a realistic, real life manner and the real- 
istic telephone icon is for use in setting up a multi- 
media call; 

displaying a call bar on the screen in prede- 
termined spatial relationship to the virtual meeting 
room metaphor, the call bar including at least an 
area for displaying calling party information, and 
multimedia call answer options; and 

selecting one of the displayed call bar answer 
options. 
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14. The method as defined in claim 13 wherein the call 
bar options include an answer option and further 
including the steps of selecting the answer option, 
removing call bar from being displayed on the 
screen, supplying the user's workstation capabilities 5 
to network, and displaying around the table icon 
image icons representing all current virtual meeting 
participants including the answering user. 

15. The method as defined in claim 13 wherein the call 
bar options include an ignore option and further 
including the steps of selecting the ignore option, 
minimizing the virtual meeting room and causing the 
incoming call to follow Hs call path. 

16. Apparatus for use in a user workstation including a 
pointing device and a visual display unit to provide 
a graphical user interface for graphically depicting in 
a realistic manner setting up and/or handling of a 
multimedia call for a multimedia virtual meeting, 
comprising: 

means for initiating a multimedia call from the 
user workstation to at least one prospective partici- 
pant of the virtual meeting; 

means for displaying in an area on a screen 
of the visual display unit at the user's workstation a 
graphical representation of a realistic virtual meeting 
room metaphor including realistic icons of at least a 
table, the user's image, at least one empty chair and 
a telephone, wherein the user's image icon and the 
at least one empty chair icon are positioned around 
the table icon in a realistic, real life manner and the 
realistic telephone icon is for use in setting up a mul- 
timedia call to the at least one prospective virtual 
meeting participant; and 

means for causing the realistic icons to be 
arranged in the virtual meeting room mtaphor being 
displayed so that the screen area displaying the vir- 
tual meeting room is minimized. 

1 7. The apparatus as defined in claim 1 6 further includ- 
ing means for selecting the realistic telephone icon 
and means for displaying a call bar on the screen in 
predetermined spatial relationship to the virtual 
meeting room metaphor in response to the selection 
of the telephone icon, the call bar including at least 
one option to be used in placing the multimedia call. 

18. The apparatus as defined in claim 17 wherein the 
call bar includes at least a dial pad option which can 
be employed in placing the multimedia call and an 
area for displaying a telephone number and further 
including means for selecting the dial pad option to 
place the multimedia call, means for displaying on 
the screen a realistic dial pad icon to input the at 
least one prospective participants telephone 
number via the dial pad, means for displaying the 
telephone number being inputted in the dial bar and 



means for causing the displayed number to be 
dialed. 

19. The apparatus as defined in claim 17 wherein the 
call bar includes at least a directory option which can 
be employed in placing the multimedia call and an 
area for displaying a telephone number, the direc- 
tory including at least names and telephone num- 
bers of individuals and further including means for 
selecting the directory option to place the multime- 
dia call, means for displaying on the screen a real- 
istic directory page icon, means for locating the 
name and telephone number in the directory of the 
at least one prospective participant, means for 
selecting the at least one prospective participant's 
telephone number from the directory, means for dis- 
playing the selected telephone number in the dial 
bar and means for causing the displayed number to 
be dialed. 

2a The apparatus as defined in claim 17 wherein the 
user workstation includes a keyboard having 
number keys and the call bar includes an area for 
displaying a telephone number and further including 
the keyboard to be used to input the at least one pro- 
spective participants telephone number via the key- 
board number keys, means for displaying an 
inputted telephone number in the dial bar and means 
for causing the displayed number to be dialed. 

21 . The apparatus as defined in claim 1 6 further includ- 
ing means for selecting the realistic telephone icon 
and means for displaying a call bar on the screen in 
predetermined spatial relationship to the virtual 
meeting room metaphor in response to the selection 
of the telephone icon, the call bar including at least 
an area to display a telephone number to be dialed, 
means for supplying a telephone number of the at 
least one prospective participant to be dialed, 
means for displaying the supplied telephone number 
in the call bar area and means for causing the dis- 
played number to be dialed, means for determining 
if the dialed number has been answered, and means 
for removing the call bar from the display upon the 
call being answered and for displaying an image icon 
representative of the answering virtual meeting par- 
ticipant over the empty chair. 

22. The apparatus as defined in claim 21 further includ- 
ing means for determining if the number of partici- 
pants in the virtual meeting is a maximum allowable 
number and means for adding an empty chair at the 
table indicating that another prospective participant 
may be added to the virtual meeting when the 
number of participants in the virtual meeting is less 
than the maximum. 

23. The apparatus as defined in claim 22 further includ- 
ing means for determining if the virtual meeting room 
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and table need to be expanded to accommodate the 
added empty chair and means for expanding the 
size of the virtual meeting room and table just 
enough to accommodate the added empty chair 
when the room is not long enough to accommodate 5 
the added empty chair. 

24. The apparatus as defined in claim 16 wherein the 
meeting room includes a tool closet including tools 
to be employed in the multimedia virtual meeting for 
collaboration and/or communication among the vir- 
tual meeting participants, the tool closet being ini- 
tially in a closed condition so that the screen area 
displaying the virtual meeting room is minimized. 

25. The apparatus as defined in claim 24 further includ- 
ing means for opening the tool closet and for display- 
ing on the screen realistic icons of the multimedia 
tools so that any one of the virtual meeting partici- 
pants having a workstation including a pointing 
device and a visual display unit may select a tool 
from the opened tool closet to collaborate and/or 
communicate with one or more of the virtual meeting 
participants. 

26. The apparatus as defined in claim 21 wherein a 
number of virtual meeting participants have been 
called and have been added to the virtual meeting 
with an image icon of each of the number of the 
added participants being placed over a respective 
chair around the table icon and further including 
means for determining if one or more of the virtual 
meeting participants have left the virtual meeting, 
means for removing the image icons of the one or 
more participants that have left the virtual meeting 
and for displaying empty chairs around the table icon 
in place of the removed one or more image icons. 

27. The apparatus as defined in claim 26 further includ- 
ing means for rearranging the image icons around 
the table icon of the remaining virtual meeting par- 
ticipants to fill the one or more empty chairs if they 
are above the image icons of the remaining partici- 
pants, the means for removing removes all but one 
of the empty chairs, means for determining if there 
is space to shrink the length of the displayed virtual 
meeting room and means for shrinking the length of 
the virtual meeting room and the table to a length 
long enough to accommodate the image icons of the 
remaining virtual meeting participants and the one 
empty chair. 

28. Apparatus for use in a user workstation including a 
pointing device and a visual display unit and a tele- 
phone to provide a graphical user interface for 
graphically depicting in a realistic manner handling 
of a multimedia call for a user to join a multimedia 
virtual meeting, comprising: 

means for receiving an incoming multimedia 



call; 

means for determining if a multimedia appli- 
cation program is running on the use workstation; 

means for ringing only the telephone if the 
multimedia application program is not running; 

means for sounding an audible alert signal at 
the user workstation to inform the user of the incom- 
ing multimedia call if a multimedia application pro- 
gram Is running; 

means for displaying in an area on a screen 
of the visual display unit at the user's workstation a 
graphical representation of a realistic virtual meeting 
room metaphor including realistic icons of at least a 
table, the user's image, at least one empty chair and 
a telephone, wherein the user's image icon and the 
at least one empty chair icon are positioned around 
the table icon in a realistic, real life manner and the 
realistic telephone icon is for use in setting up a mul- 
timedia call; 

means for displaying a call bar on the screen 
in predetermined spatial relationship to the virtual 
meeting room metaphor, the call bar including at 
least an area for displaying calling party information, 
and multimedia call answer options; and 

means for selecting one of the displayed call 
bar answer options. 

29. The apparatus as defined in claim 28 wherein the 
call bar options include an answer option and further 
including means for selecting the answer option, 
means for removing the call bar from being dis- 
played on the screen, means for supplying the user's 
workstation capabilities to network, and means for 
displaying around the table icon image icons repre- 
senting all current virtual meeting participants 
including the answering user. 

30. The apparatus as defined in claim 28 wherein the 
call bar options include an ignore option and further 
including means for selecting the ignore option, 
means for minimizing the virtual meeting room and 
means for causing the incoming call to follow 

its call path. 
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